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Overview 

The  objective  of  this  proposal  was  to  build  a  multi- vehicle  testbed  to  demonstrate  and 
evaluate  the  coordination  and  control  approaches  under  development  at  MIT  as  part  of 
several  ongoing  DoD  funded  research  programs.  This  work  was  motivated  by  the  observation 
that  a  key  step  towards  transitioning  these  high-level  algorithms  to  future  missions  will  be  to 
successfully  demonstrate  that  they  can  handle  similar  challenges  on  scaled  vehicles  operating 
in  realistic  environments. 

Two  unique  testbeds  have  been  developed  at  MIT  to  perform  these  demonstrations.  The 
testbeds  have  been  designed  to  reflect  the  complexity  expected  in  future  combat  operations 
and  are  comprised  of  many  (semi-)  autonomous,  heterogeneous  vehicles.  We  used  simple  ve¬ 
hicles  (UAVs, blimps,  rovers)  so  that  many  of  them  could  be  “flown”  together.  This  provides 
a  good  combination  of  flexibility,  agility,  and  mobility,  and  allows  us  to  use  the  testbed  in  a 
broad  range  of  applications.  Of  particular  significance  is  the  goal  of  having  many  of  these 
vehicles  working  in  coordinated  fashion  to  provide  surveillance,  detection,  assessment,  and 
tracking  of  multiple  moving  targets. 

This  report  discusses  the  two  testbeds  that  were  developed  with  the  DURIP  grant,  showing 
that  all  of  the  objectives  were  met  and  that  they  provide  excellent  facilities  for  demon¬ 
strating  advanced  coordination  and  control  concepts  in  real-time,  in  realistic  environments. 
Performing  experiments  on  these  testbeds  will  highlight  the  fundamental  challenges  asso¬ 
ciated  with:  (i)  planning  for  a  large  team  in  real-time;  (ii)  developing  controllers  that  are 
robust  to  uncertainty  in  the  situational  awareness,  and  are  sufficiently  flexible  to  respond 
to  dynamic  changes;  and  (iii)  using  communication  networks  and  distributed  processing  to 
develop  integrated  and  cooperative  plans. 

The  testbeds  have  been  used  to  support  several  research  and  educational  projects  at  MIT: 

•  AFOSR  Cooperative  Control  Theme 

•  DARPA  Mixed-Initiative  Control  of  Automa-teams  (MICA) 

•  DARPA  Software  Enabled  Control  (SEC) 

•  MIT  Senior  Capstone  design  class  (16.821  Flight  Vehicle  Development) 

Proposals  have  been  submitted  to  the  DoD  ACO  and  DARPA  HURT  programs  that  will  use 
the  testbeds. 
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Fig.  1  :  4  of  8  rovers.  Fig.  2:  1  of  4  blimps. 


Testbed  Description 

This  testbed  has  been  designed  to  simulate  many  challenging  operational  scenarios  that  are 
of  direct  interest  to  the  AFOSR.  The  specific  focus  is  in  the  area  of  cooperative  coordination 
and  control  of  multiple  vehicles  for  missions  such  as: 

1.  Low-cost  multi-target  surveillance  and  tracking 

2.  Wide-spread  search  missions 

3.  Suppression  of  enemy  air  defenses  (SEAD) 

4.  Moving  target  location  and  tracking 

These  missions  typically  require  the  close  coordination  and  control  of  many  different  types  of 
vehicles  {e.g.,  manned  vehicles  {fighters,  strike,  and  electronic  suppression},  semi-autonomous 
UAVs  {fixed-wing  and  helicopters},  surveillance  aircraft  and  satellites,  communication  vehi¬ 
cles  {AWACS},  and  ground  forces)  to  accomplish  the  overall  objectives.  Two  unique  testbeds 
have  been  developed  at  MIT  to  analyze  the  performance  of  the  high-level  planning  algorithms 
for  these  types  of  missions.  One  uses  multiple  rovers  and  blimps  operated  indoors  to  em¬ 
ulate  a  heterogeneous  fleet  of  vehicles  performing  a  search  and  rescue  mission.  The  second 
uses  eight  UAVs  that  are  flown  autonomously  using  a  commercially  available  autopilot  from 
Cloud  Cap  Technology. 

Rover/Blimp  Testbed  -  The  first  testbed  uses  multiple  (8)  rovers  and  blimps  (4)  operated 
indoors  to  emulate  a  heterogeneous  fleet  of  vehicles  that  could  be  used  to  perform  SEAD 
type  missions.  The  rovers  in  Fig.  1  are  ActivMedias  P3-ATs.  A  Sony  VAIC  mounted  on 
each  rover  processes  sensor  data  and  performs  the  low-level  control.  All  high-level  planning 
is  done  off-board  using  laptops  running  MATLAB,  AMPL,  and  CPLEX,  but  with  a  direct 
wireless  Ethernet  connection,  this  is  essentially  the  same  as  having  both  laptops  onboard. 
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Fig.  5:  Cloud  Cap  Piccolo  autopilot. 


The  ArcSecond  Constellation  3D-i  laser  metrology  system  is  used  to  measure  the  vehicle 
position  indoors^  This  has  been  verified  to  give  4mm  position  accuracy  at  20Hz.  The 
twelve  channel  receiver  provides  both  raw  Code  phase  and  carrier  phase  measurements  for 
all  tracked  satellites.  The  7ft  diameter  blimps  in  Fig.  2  were  scaled  to  carry  the  VAIO  and 
will  have  an  identical  control  architecture.  The  indoor  tests  can  be  performed  at  the  MIT 
Johnson  Athletic  Center  which  has  a  room  with  dimensions  65x125x25  ft.  The  rovers  can 
also  be  outfitted  with  the  Canadian  Marconi  Company  Superstar^^  receiver  for  outdoor 
operations. 

The  video  cameras  on  the  rovers  are  four  Axis  EVI-D30  with  remote  controlled  pan  tilt  and 
object  tracking  capabilities.  Each  camera  outputs  analog  video  to  an  Axis  2401  video  server 
which  converts  the  signal  into  digital  video  and  transmits  it  over  Ethernet  to  a  wireless 
bridge.  This  digital  video  is  then  transmitted  to  the  ground  station,  which  can  show  the 
four  videos  at  the  same  time.  Additionally,  the  pan/tilt  and  object  tracking  capabilities  of 
the  cameras  can  be  exploited  remotely  from  the  ground  station. 

UAV  Testbed  -  8  UAVs  have  been  built  to  provide  a  platform  for  flight  testing  and  evaluation 
of  the  coordination  and  control  algorithms  (Fig.  3).  Small  aircraft  (RC-sized  trainers)  were 
purposefully  chosen  to  reduce  operational  complexity  while  still  providing  a  high  degree  of 
flexibility  in  the  missions  that  can  be  performed.  Only  slight  modifications  are  required  to 
increase  the  payload  and  endurance  requirements  (3  lbs.,  20  mins  respectively)  for  a  SEAD 

^See  White  paper  063102,  “Constellation  3Di  Error  Budget  and  Specifications,”  Copyright  2002,  Arc 
Second,  Inc.  Dulles,  VA  {www.arcsecond.com} 
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Fig.  6  :  Trailer  used  to  store  and  transport  the  UAVs. 

type  mission  demonstration.  Fig.  3  shows  several  of  the  modified  Tower  Trainer  planes  in 
the  fleet.  The  Piccolo^^  autopilot  from  Cloud  Cap  (Fig.  5)  is  used  onboard  the  aircraft 
to  perform  the  autonomous  waypoint  navigation  and  vehicle  stabilization,  primarily  using 
GPS,  IMU  and  air  data  measurements^.  One  Watt  transmission  of  data  over  the  912  MHz 
band  permits  the  vehicles  to  navigate  up  to  three  miles  from  the  ground  station  (Fig.  4)  and 
new  plans  can  be  continuously  uploaded  to  the  vehicles  through  this  channel. 

A  wireless  video  system  has  been  integrated  with  the  UAV  testbed  to  produce  high  quality 
images  from  the  airborne  vehicles  Fig.  8  shows  a  typical  aerial  shot  from  one  of  the  UAVs. 
This  system  is  used  to  verify  the  position  of  the  vehicles  and  provide  user  feedback  for  high 
level  decision  making.  We  have  recently  negotiated  a  deal  to  fly  the  UAV  testbed  at  the 
Crow  Island  Airfield  in  Maynard,  MA  (see  Figs.  7  and  8),  but  have  also  discussed  with 
Robert  Murphey  the  possibility  of  doing  more  extensive  testing  at  Eglin  AFB.  The  trailer 
purchased  to  store  and  move  the  UAVs  and  rovers  is  shown  in  Figure  6. 

The  autopilots  can  also  be  tested  on  the  ground  using  the  hardware  in  the  loop  simulation 
environment  shown  in  Figure  9.  The  figure  shows  the  autopilots  (top  right)  being  stimu¬ 
lated  by  separate  CPUs.  The  data  is  then  passed  to  the  ground  station  (other  side  of  the 
laboratory)  using  the  912  MHz  link,  where  it  is  displayed  to  the  operator  of  the  UAV  team 
(bottom)  and  passed  onto  the  planning  processors  (separate  bank  of  CPUs  top  left).  A  3 
GHz  Dell  desktop  computer  with  2  laxge  monitors  serves  as  the  operator  ground  station  for 
all  of  the  testbeds.  Prom  this  location  all  of  the  vehicles  and  planning  algorithms  can  be 
monitored  through  an  integrated  GUI  which  allows  the  creation  of  mission  scenarios  and 
dynamic  changes  to  the  state  of  the  world  {e.g.,  avoidance  regions,  targets). 

Planning  Computers  and  Wireless  Network  -  The  12  Dell  planning  laptops  (top  left  of  Fig¬ 
ure  9)  are  connected  together  on  a  100  Mbps  Ethernet  (the  wired  network).  A  wireless 

2  WWW .  cloudcaptech .  com 
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Fig.  7:  Local  flying  fleld  at  Crow  Island.  Is¬ 
land  is  approximately  2000ft  long.  Main  run¬ 
way  for  UAVs  to  the  right,  which  leaves  a  very 
large  area  to  the  left  to  use  for  the  rovers. 


Fig.  8:  Overhead  of  the  local  flying 
field  at  Crow  Island  taken  with  the  on¬ 
board  camera. 


Ethernet  access  point  is  also  attached  to  this  network  which  connects  the  Dells  with  the 
VAIOs  on  the  rovers  (802.11b  wireless  Ethernet  network  at  11  Mbps).  The  access  point  is 
a  Linksys  WAPll  with  a  WSB24  signal  booster  to  increase  range  and  reliability  of  the  net¬ 
work.  The  VAIOs  use  their  internal  wireless  network  cards.  All  of  the  main  pieces  of  software 
(controller,  MATLAB)  use  TCP/IP  to  communicate,  which  is  easy  to  use  and  maintain.  The 
Dell  computers  are  also  equipped  with  a  10-seat  license  for  CPLEX  V8.0  which  is  used  by 
the  high-level  planning  algorithms. 

Additionally,  there  is  a  second  wireless  network  at  54  Mbps  based  on  the  802.  llg  standard 
that  connects  the  base  station  to  four  video  cameras  in  the  rovers.  The  components  of  this 
network  are:  a  Netgear  WG602  Access  Point  also  connected  to  the  100  Mbps  wired  Ethernet, 
and  four  Netgear  WGlOl  wireless  bridges  on  the  rovers.  These  bridges  are  connected  to  the 
digital  video  servers  through  Ethernet  cable.  The  range  and  reliability  of  the  network  is 
increased  by  attaching  a  18  dBi  Netgear  patch  panel  gain  antenna  to  the  access  point, 
and  four  5  dBi  Netgear  omnidirectional  antennas  attached  to  the  wireless  bridges.  The 
high  bandwidth  of  this  network  is  ideal  for  transmitting  digital  video.  By  using  a  different 
wireless  channel,  this  network  works  independently  of  the  network  that  connects  the  VAIOs. 
This  ensures  that  the  high  volume  of  digital  video  never  interferes  with  the  more  sensitive 
connections  used  to  control  the  rovers.  There  are  also  four  SRM6000  (Data-Linc  Group) 
radio  modems  for  longer  range  communications  (Ri5km). 

Control  Architecture  -  Figure  10  shows  the  control  architecture  used  for  the  UAVs,  but  the 
setup  is  very  similar  for  the  rovers  and  blimps.  Low-level  control  and  the  basic  estimation 
tasks  are  run  onboard,  and  the  planning  for  the  vehicles  is  done  off-board.  The  planner 
outputs  dynamically  feasible  waypoint  lists  and  actions  (i.e.,  classify,  strike,  assess)  to  the 
vehicles,  and  monitors  the  uncertain  states  of  the  vehicles  and  the  situational  awareness. 
When  significant  changes  to  the  situational  awareness  are  detected,  the  cost  map  is  then 
updated,  the  tasks  are  re-assigned  and/or  the  trajectories  are  redesigned. 
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Fig.  9:  Hardware  in  the  loop  configuration  for  the  UAV  testbed.  Multiple  autopilots  (top 
right)  are  independently  run  by  simulation  software  to  simulate  in-flight  demonstrations  of 
the  coordination  algorithms. 

Note  that  the  system  infrastructure  was  set  up  to  allow  us  to  simulate  a  fully  integrated 
fleet  of  UAVs  -  all  data  passes  through  a  central  hub  that  performs  data  management  be¬ 
tween  the  planning  computers  and  vehicles,  effectively  simulating  communication  delays, 
vehicle  sensors  and  uncertainty  in  the  environment.  Using  this  setup  greatly  simplifies  the 
testbed,  while  maintaining  nearly  all  of  the  functionality  of  a  fully  integrated  system.  For 
example,  as  shown  in  Figures  11  and  12,  we  can  use  our  testbed  to  investigate  the  impact 
of  communication  networking  issues  on  the  coordination  problem  by  imposing  various  limi¬ 
tations/constraints  on  how  the  planning  laptops  communicate  (using  their  own  wireless  or 
Ethernet  links).  Future  work  will  demonstrate  the  effectiveness  of  various  control  architec¬ 
tures  on  the  task  assignment  process,  as  would  be  seen  in  utilizing  dynamic  sub-teams  of 
various  compositions. 
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j 


Figure  10:  System  algorithm  architecture  for  rover,  blimp  and  UAV  testbeds. 
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Fig.  11:  Control  architecture:  Decentralized 
path  planning/Centralized  task  assignment. 


Fig.  12:  Control  architecture:  Decentralized 
path  planning/Distributed  task  assignment. 


Results 

Typical  results  from  experiments  already  performed  on  these  two  testbeds  are  shown  in 
Figs.  13  and  14.  Fig.  13  shows  indoor  results  using  rovers  with  dynamics  constrained  so 
that  they  emulate  UAVs  (the  vehicles  move  at  a  constant  speed  with  a  limited  turn  radius). 
The  four  rovers  are  tasked  to  execute  a  SEAD  mission  in  an  environment  with  one  centrally 
located  avoidance  region  and  a  removable  SAM  site.  They  are  divided  into  two  sub-teams  of 
strike  and  bomb  damage  assessment  (BDA)  vehicles,  and  each  is  assigned  two  targets.  This 
experiment  demonstrated  the  ability  to  dynamically  reassign  tasks  when  one  of  the  BDA 
vehicles  (Rover  1)  is  stopped  before  completing  all  of  its  tasks  and  the  second  BDA  mem¬ 
ber  has  to  finish  the  mission.  Many  multi-UAV  simulations  have  also  been  performed  with 
the  hardware-in-the-loop  autopilot  simulators  (Fig.  9)  and  the  UAVs  have  been  operated 


7 


February  29,  2004 


DURIP  Multi-vehicle  Testbed 


4  Rover  Scenario 
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Fig.  13:  Four  rover  experimental  data  from 
a  typical  SEAD  mission. 


Fig.  14:  Data  from  2  UAVs  flying  simulta¬ 
neously. 


autonomously  on  numerous  occasions.  Fig.  14  shows  recent  results  with  two  of  the  UAVs 
simultaneously  flying  the  same  waypoints  (note  that  the  vertical  offset  was  added  intention¬ 
ally).  By  varying  the  commanded  speed  we  were  able  to  execute  a  fairly  tight  formation 
flying  maneuver  with  the  two  vehicles. 

More  recent  results  are  included  in  the  following  references: 

1.  A.  G.  Richards,  Y.  Kuwata,  and  J.  R  How,  “Experimental  Demonstrations  of  Real- 
Time  MILP  Control,  Proceedings  of  the  AIAA  Guidance,  Navigation,  and  Control 
Conference,  August  2003,  (AIAA  Paper  2003-5802). 

2.  E.  King,  M.  Alighanbari,  Y.  Kuwata,  and  J.  How,  “Coordination  and  Control  Experi¬ 
ments  on  a  Multi- vehicle  Testbed,  to  appear  at  the  IEEE  American  Control  Conference, 
2004. 

3.  Ellis  King,  Mehdi  Alighanbari,  and  Jonathan  How,  “Experimental  Demonstration  Of 
Coordinated  Control  For  Multi- Vehicle  Teams,  to  appear  at  the  16th  IF  AC  Symposium 
on  Automatic  Control  in  Aerospace,  June  2004. 

4.  L.  Bertuccelli,  M.  Alighanbari,  J.  How,  “Robust  planning  for  coupled,  cooperative 
UAV  missions,”  submitted  to  the  IEEE  CDC,  2004. 

5.  E.  King,  Y.  Kuwata,  M.  Alighanbari,  and  J.  How,  “Coordination  And  Control  Ex¬ 
periments  for  UAV  Teams,”  presented  at  the  27th  Annual  AAS  Guidance  and  Control 
Conference,  Breckenridge,  Colorado,  February  4-8,  2004  (04-014). 


And  theses: 


1.  C.  Sae-Hau  Avionics  and  Software  for  a  Distributed  Multi-rover  Testbed,  EE,  MIT, 
Aug.  2004 
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2.  Yoshiaki  Kuwata,  Real-time  Trajectory  Design  for  Unmanned  Aerial  Vehicles  using 
Receding  Horizon  Control,  S.M.  Thesis,  Dept,  of  Aeronautics  and  Astronautics,  MIT, 
June  2003. 

3.  Ellis  King,  Demonstration  of  Distributed  Coordination  and  Control  on  a  multi-UAV 
Testbed,  S.M.  Thesis,  Dept,  of  Aeronautics  and  Astronautics,  MIT,  expected  May 
2004. 

4.  L.  Bertuccelli,  Cooperative  Mapping  Algorithms  for  a  Fleet  of  UAVs,  S.M.  Thesis,  Dept, 
of  Aeronautics  and  Astronautics,  MIT,  expected  June  2004. 


Summary 

As  these  multi-vehicle  testbeds  mature,  we  will  be  able  to  demonstrate  more  sophisticated 
experiments  such  as: 

•  Multi-vehicle  execution  of  a  representative  SEAD  mission  which  includes  dynamic 
teaming/tasking,  coordination  of  recon/strike/BDA  tasks  and  execution  despite  im¬ 
perfect  information  about  the  world  and/or  other  team  members. 

•  Coordination  of  multiple  heterogeneous  vehicles  Both  autonomous  air  and  ground 
vehicles  will  be  used  in  conjunction  to  demonstrate  the  use  of  multiple  vehicle  sys¬ 
tems  with  different  capabilities.  For  example,  the  blimps  were  designed  to  perform 
reconnaissance  and  classification  tasks  in  conjunction  with  the  rovers  that  act  as  strike 
vehicles.  And  the  UAVs  can  be  used  to  map  the  environment  for  the  rovers. 

•  Constrained  network/communications  Demonstrations  of  system  performance  using 
imperfect  information  and  limited  communication  between  vehicles.  This  experiment 
will  provide  a  realistic  demonstration  of  the  performance  of  a  team  of  UAVs  operating 
under  limited  communications/information  constraints.  Depending  on  the  scenario 
used,  these  constraints  can  be  imposed  artificially  or  would  occur  naturally  due  to  the 
extensive  range  between  vehicles. 

Our  experience  has  shown  that  experiments  on  real  vehicles  are  very  stressing  for  these 
planning  algorithms  and  repeated  successful  experimental  demonstrations  of  these  algorithms 
will  be  a  significant  milestone  for  the  cooperative  control  theme. 
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